Homotopy for Rational Riccati Equations Arising in Stochastic Control
نویسندگان
چکیده
We consider the numerical solution of the rational algebraic Riccati equations in Rn, arising from stochastic optimal control in continuousand discrete-time. Applying the homotopy method, we continue from the maximal stabilizing solutions of the deterministic algebraic Riccati equations, which are readily available. The associated differential equations require the solutions of some generalized Lypunov or Stein equations, which can be solved by the generalized Smith methods, of O(n3) computational complexity and O(n2) memory requirement. For large-scale problems, where the relevant matrix operators are sparse, our algorithms are of O(n) complexity and memory requirement. Compared with the alternative (modified) Newton’s methods, our algorithms are easy to implement and do not require any difficult initialization. Some illustrative numerical examples are provided.
منابع مشابه
Generalized Riccati Equations Arising in Stochastic Games
We study a class of rational matrix differential equations that generalize the Riccati differential equations. The generalization involves replacing positive definite “weighting” matrices in the usual Riccati equations with either semidefinite or indefinite matrices that arise in linear quadratic control problems and differential games−both stochastic and deterministic. The purpose of this pape...
متن کاملOn the parameter dependence of a class of rational matrix equations occurring in stochastic optimal control
This paper is concerned with rational matrix equations occuring in stochastic control that play an analogous role as the algebraic Riccati equation does in deterministic control. We will therefore sometimes refer to these equations as stochastic (algebraic) Riccati equations. A first rigorous treatment of a stochastic Riccati equation from LQ-control theory seems to have been undertaken by Wonh...
متن کاملA Solution of Riccati Nonlinear Differential Equation using Enhanced Homotopy Perturbation Method (EHPM)
Homotopy Perturbation Method is an effective method to find a solution of a nonlinear differential equation, subjected to a set of boundary condition. In this method a nonlinear and complex differential equation is transformed to series of linear and nonlinear and almost simpler differential equations. These set of equations are then solved secularly. Finally a linear combination of the solutio...
متن کاملRiccati Equations from Stochastic LQR Problem
In this paper we consider a class of matrix Riccati equations arising from stochastic LQR problems. We prove a monotonicity of solutions to the differential Riccati equations, which leads to a necessary and sufficient condition for the existence of solutions to the algebraic Riccati equations. In addition, we obtain results on comparison, uniqueness, stabilizability and approximation for soluti...
متن کاملIterative methods for a linearly perturbed algebraic matrix Riccati equation arising in stochastic control
We start with a discussion of coupled algebraic Riccati equations arising in the study of linear-quadratic optimal control problem for Markov jump linear systems. Under suitable assumptions, this system of equations has a unique positive semidefinite solution, which is the solution of practical interest. The coupled equations can be rewritten as a single linearly perturbed matrix Riccati equati...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013